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Introduction 

For some homogeneous spaces the method of horospheres delivers an effective way to decompose repre- 
sentations in irreducible ones. For Riemannian symmetric spaces Y = G/K horospheres are orbits of 
maximal unipotcnt subgroups of 67. They are parameterized by points of the horosphcrical homogeneous 
space Sk = G/MN where JV is a fixed maximal unipotent subgroup and M = Zk(A) as usual. The 
horosphcrical transform maps sufficiently regular functions on Y to the corresponding average along the 
horospheres. The crucial point is, that the abelian group A acts on S and that this action commutes 
with the action of G. The decomposition of the natural representation of G in L 2 (S) in irreducible ones 
reduces to the decomposition relative to A. In this way we obtain all unitary spherical representations 
on Y (with constant multiplicity), except the complementary series. The computation of the Plancherel 
measure on Y is equivalent to the inversion of the horosphcrical transform. 

The method of horospheres works for several other types of homogeneous spaces, including complex 
semisimple Lie groups (considered as symmetric spaces) but it has very serious restrictions: discrete series 
representations lie in the kernel of the horospherical transform, as well as all representations induced 
from parabolic subgroups that are not minimal. In short, the kernel is the orthocomplement of the 
most continuous part of the spectrum. The simplest example when the horospherical transform can 
not be inverted is for the group SL(2,R). In 0] |5J |H] a modification of the method of horospheres 
was suggested: complex horospherical transform (the horospherical Cauchy- Radon transform). For a 
homogeneous space X we consider the complexification Xc and instead of real horospheres on X we 
consider complex horospheres on Xc without real points (they do not intersect X). The integration along 
a real horosphere is equivalent to the integration of a 5-function on X with support on this horosphere. In 
the complex version we replace this ^-function by a Cauchy type kernel with singularities on the complex 
horosphere without real point. In |S] it is shown that such a complex horospherical transform has 
no kernel for SL(2;K) and that it reproduces the Plancherel formula; in 6 it is shown for all compact 
symmetric spaces. 

The objective of this paper is to show that the complex horospherical transform has no kernel on the 
holomorphic discrete series. Holomorphic discrete series exist for affine symmetric spaces X — G/H of 
Hermitian type; G is here a group of Hermitian type |2] • The corresponding part of L 2 (X) can 
be realized as boundary values of Hardy space H 2 (D + ) in a Stein tube D + C Xc with edge X 
Our aim is to define a complex horosphcrical transform which has no kernel on holomorphic iJ-spherical 
representations . 
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The first step is a construction of the space that is going to be the image of the complex horospherical 
transform. For that, we consider those complex horospheres in the Stein symmetric space Xc — Gc/Hc 
that are parameterized by points of the complex horospherical space S = Gc/McNc- ln S we then 
consider an orbit S + of G x T + where 7+ is an abelian semigroup in the complex torus 7c = AT with 
the compact torus T as the edge. The space of holomorphic functions on S + is the Frechet model 

of the holomorphic discrete series. More exactly, if we decompose this representation with respect to 
the compact torus T we obtain G- modules which are lowest weight modules (if they are irreducible); we 
obtain all such modules with multiplicity one. Using the abelian semigroup 7+ we can define a Hardy 
type space 7i 2 (S + ) with spectrum "almost all" of the holomorphic discrete series. 

The next step is a geometrical background for the construction of the horospherical transform. Firstly, 
we prove that the horospheres E(£) parameterized by points £ G S + do not intersect X. We construct 
a simple Cauchy type kernel which has no singularities on X and the edge of its singularities coincides 
with E(£). Using this kernel we define the horospherical Cauchy transform from L l {X) to 0(S + ) which 
can be extended on L 2 (X). The horospherical transform decomposed under T yields the holomorphic 
spherical Fourier transform. 

The last step is the inversion of the horospherical Cauchy transform. We give the Radon type inversion 
formula using results from ^1] for the holomorphic discrete series. Let us remark that for X = SL(2,R) 
the inversion formula was obtained in with tools from integral geometry on quadrics. This method 
automatically extends on any symmetric spaces of Hermitian type of rank 1, i.e., the hyperboloids of 
signature (2, n). Let us also pay attention to the complete similarity of formulas of this paper and 
formulas in |B] for compact symmetric spaces. It confirms the view that finite-dimensional spherical 
representations are similar to representations of holomorphic discrete series. 

1. Symmetric spaces of Hermitian type 

The objective of this section is to set up a standard choice of terminology that will be used throughout 
the text. 

Let us fix some conventions upfront. For a real Lie algebra g let us denote by gc — 9 ®>R C its 
complexification. Likewise, if not stated otherwise, for a connected Lie group G we write Gc for its 
universal complexification. If tp : G — > H is a homomorphism of connected Lie groups, then we will also 
denote by cp 

• the derived homomorphism d(p(l) : Lie(G) — > Lie(if), 

• the extension of tp to a holomorphic homomorphism Gc — » He. 

Let G be a connected semisimple Lie group with Lie algebra g. We assume that G C Gc and that Gc 
is simply connected. Let r : G — > G be a non-trivial involution and write H, resp. He, for the r- fixed 
points in G, resp. Gc- The object of concern is the affine symmetric space X = G/H . We observe that 
X is contained in its complexification Xc — Gc/Hc as a totally real submanifold. Write Xo = He for the 
base point in Xc- 

Let f) be the Lie algebra of H and note that g = f) + q with r| q = — id q . The symmetric pair (g, f)) is 
called irreducible if g does not contain any r-invariant ideals except the trivial ones, {0} and g. In that 
case, either g is simple or g = gi x gi with gi simple and t(x, x') = (x' , x). We say that X is irreducible, 
if (g, [)) is irreducible. From now on we will assume, that X is irreducible. 

Fix a Cartan involution : G — > G commuting with r. Denote by K < G the subgroup of 6>-fixed 
points and write Y = G/K for the associated Riemannian symmetric space. Write 6 for the Lie algebra 
of K. Then g = t + s with 6\ s — — id s . Notice that the universal complexification Kc of K naturally 
identifies with the #-fixed points in Gc- 

We will assume that G is a Lie group of Hermitian type, i.e. Y is Riemannian symmetric space of 
Hermitian type. The assumption can be phrased algebraically: 3(6) ^ {0} with 3(6) the center of 6. 
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We assume that r induces an anti-holomorphic involution on Y and then call A an affine symmetric 
space of Hermitian type. 

Remark 1.1. (a) Our assumptions on G and r can be phrased algebraically, namely: 
(A) 3(«)nq^{0}. 

Let us mention that another way to formulate (A) is to say that q admits an iJ-invariant regular elliptic 
cone, i.e. A is compactly causal |10| . 

(b) Symmetric spaces of Hermitian type resemble compact symmetric spaces on an analytical level. 
Combined they form the class of symmetric spaces which admit lowest weight modules in their L 2 - 
spectrum (holomorphic discrete series). 

Since X is irreducible, it follows that 3(6) n q = 1M.Z0 is one dimensional. It is possible to normalize 
Z in such a way that the spectrum of ad(Z ) is { — 1,0,1}. The zero-eigenspace is 6c- We denote the 
+l-eigenspace in Sc by s + , and the — 1-eigenspace by s~. 

Let t be a maximal abelian subspace in q containing iZg. Then t is contained in t n q. Set a = it and 
note that ac — tc< 

Let A be the set of roots of tc in jjc, 

A„ = {a £ A I g C s c } = {a £ A | a(Z ) £ {-1, 1}} 

and 

A fc = {a £ A I g C t c } = {a £ A | a(Z ) = 0} . 

Then A = AkUA n . The elements of A„ are called non- compact roots, and the elements in A& are called 
compact roots. We choose an ordering in it* such that a(Z ) > implies that a £ A+ C A+. Let W be 
the Weyl group of A and Wk the subgroup generated by the reflections coming from the compact roots. 
As s(Zq) = Zq for all s £ Wk, it follows that A+ is Wk -invariant. 

1.1. Polyhedrons, cones and the minimal tubes. Set A = cxp(a), Ac = exp(oc), T = exp(t) and 
Tc = exp(tc). We note that 

A c = T c = TA ~ T x A . 
For a £ A let a £ a be its coroot, i.e. a £ [gg, g^"] (~l a and a(a) = 2. Then 

(1.1) n= K>o-a 

defines a W/c-invariant open convex cone in a = it which contains Zq. Often one refers to f2 as the minimal 
cone (it is denoted c m i n in |1(J|L Let us remark that one can characterize £1 as the smallest W^-invariant 
open convex cone in a which contains a long non-compact coroot, i.e. 

(1.2) fl = co (W fc (M>o • &)) {a long in A+) . 

Here co(-) denotes the convex hull of (•). 

We set A + = cxp(O) and note that A + C A is an open semigroup. Moreover 

T+ = Texp(O) = TA+ C T c 

defines a semigroup and complex polyhedron with edge T. We also use the notation A- = exp(— Q) and 

Define G-invariant subsets of Ac by 

D± = GA± ■ x C A c . 

According to |18j D + and _D_ are Stein domains in Ac with X = G ■ xq as Shilov boundary. Subsequently 
we will refer to D + and £)_ as minimal tube in Ac with edge X. 
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1.2. Minimal 6*r-stable parabolics. Denote by g i— > g the complex conjugation in Gc with respect to 
the real form G. Let 

Set 

m c = {U e f) C I (W G t) [U, V] = 0}, 

and 

pc = mc © tc © n c . 

Notice, that mc is contained in tc, as %o G tc- The Lie algebra pc is a minimal 9t -stable parabolic 
subalgebra of gc- Define subgroups of Gc by Mc = Zh c (ic) C Kc, and iVc = cxp(nc). 
Note that Tc — Ac- Then the prescription 

P c = M C A C N C = M C T C N C 

defines a minimal Qr-stable parabolic subgroup of Gc whose Lie algebra is pc- Write T = McflAc = MC\T 
and observe that L is a finite 2-group. The isomorphic map 

(M c x r A c ) x iV c -> P c , ([m,a],n) i-> man 

yields the structural decomposition of Pc- 

We denote by t C c a r-stable Cartan subalgebra of g contained in t. Then c = t®Ch, where Ch = cflf). 
Denote by £ the set of roots of cc in gc- Similarly we set £„, the set of non-compact roots, the set 
of compact roots. We choose a positive system S + such that E + | t \{0} = A+. 

Define tori in G by C — cxp c and Ch = cxp z h . We note that G = TCh — T x r Ch ■ 

2. Complex Horospheres I: Definition and basic properties 

The objective of this section is to discuss (generic) horospheres on the complex symmetric space 
Xc = Gc/ He- We will show that the space of horospheres is Gc-isomorphic to the homogeneous space 
2 = Gc/McNc- Further we will introduce a G- invariant subdomain S + C S which will be a central 
object for the rest of this paper. 

Set 

S = Gc/McNc 

and write £o = MciVc for the base point of S. Usually we express elements £ G 5 as £ = g ■ £o f° r 9 G Gc- 
Consider the double fibration 

(2.1) Gc/Mc 





Xc • 

By a horosphere in Xc wc understand a subset of the form 

(2-2) E(Q=n 2 fc 1 (Q) (£ G H) . 

For £ = .9 • £o we record that 

£(0 = gM c X c • so = .9^Vc • C X c 

(use M c C i? c )- 

Similarly, for z G Xc we set 

(2.3) S(z)=n 1 (^ 1 (z)) . 
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If z = g ■ xo for g £ Gc, then notice S(z) = gHc ■ £o- Moreover, for z £ Xc and £ € S one has the 
incidence relations 

(2.4) z £ E(£) <=> 7rr X (0 n tt^ 1 (z) ^ ^ C e 5(z) . 
The space of horospheres on Xc shall be denoted by Hor(Ac), i.e. 

Hor(A c ) = {E(0 | £ G S} . 
Our first objective is to show that S parameterizes Hor(Ac): 
Proposition 2.1. Tfte map 

E :S^Hor(A c ), £ ^ 

is a Gc-equivariant bijection. 

Proof. Surjectivity and Gc-equivariance are clear by definition. It remains to establish injectivity. For 
that write G c for the stabilizer of -E(£o) in Gc- By Gc-equivariance it is enough to show that 
Gc (5o) C M C N C . Assume that g ■ E(£ ) = Efa). Then gN c C A c Hc. In particular, g = nh £ N C H C - 
As Gp^ " 1 is a group, and n S G^°\ it follows, that ft. S G^°\ By Lemma f2. 21 from below it follows 
that ft S Mc- Hence g = h{h~ l nh) £ McNc, as Mc normalizes Nc- □ 

Lemma 2.2. Assume that ft £ He is such that h ■ E(£q) = -E'(Co)- Tften ft € Mc- 

Proof. Identify the tangent space T Xo (Gc/Hc) with 0c/f)c- Then, as (ftAcft -1 ) ■ xo = Nc ■ x , it follows 
that 

Ad(ft)(n c © f)c) = n c ffif)c- 
Thus, if U G nc, there exists Z £ nc and L e l)c such that Ad(ft)[7 = Z + L. Applying (1 — t) this 
equality, we get Ad(h)(U — t(U)) = Z — t(Z). As qc = (1 — t)(hc) © tc, an( i this sum is orthogonal with 
respect to Killing form, it follows that Ad(ft)tc = tc- In particular, ft, G Nndtc)- 

We recall the Riemannian dual X r = G r /K r of X = G/H which corresponds to the Lie algebras 
g r = V +s r with f = (f) nt) + i(i) lis) and s r = i(qC\t) + (q lis). Notice that a is maximal abelian in s r . 

To continue with the proof, we observe that Njj c (ic) — NRr(a)Mc- Thus we may assume that 
ft G A^r(a). Write ay for the complex conjugation in Gc with respect to the real form G r . Then taking 
a r fixed points in ftA c G N C H C yields ftA r G N r K r with N r = G r n% Thus the situation is reduced 
to the Riemannian case where it follows from p. 78. □ 

It is crucial to observe that there is a Tc-action on S which commutes with the left Gc-action: 

Proposition 2.3. Let £ = g ■ £o G S, g £ Gc- For t £ Tc the prescription 

(2.5) f • t = gt ■ Co 
defines an element of S. In particular, 

(2.6) IcxS^H, 

defines an action of Tc on S, which commutes with the natural action of G on S. 

Proof. As Tc normalizes Ale Ac it follows that l|2.5[l is defined. Finally, (|2.5() implies that (|2.6() . defines 
a left-action of Tc. □ 

It is obvious that the map 

(2.7) (GcxTc)xS^S, ((«?,<), £) -» 5 • £ • t 

is a holomorphic action of the complex group Gc X Tc on the homogeneous space S. 

The remainder of this section will be devoted to the definition and basic discussion of an important 
G x T-invariant subset S + of H. 
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We recall from Subsection 11.11 the polydisc 7+ = TA+ and define 

S + = GT + ■ £ = GA + ■ £ ■ 

We record that 2 + is a (G x T)-invariant subset of S. 

The set GPc is open in Gc and G D Pc = MT. Hence G/MT can be viewed as an open, complex 
submanifold of the flag manifold F = Gc/Pc- We write F + = GPc/Pc for the image of G/MT in F and 
call F+ the flag domain. Although obvious we emphasize that F + is G-homogeneous. 

Notice G/MT is the base space of the holomorphic fiber bundle G/M Xj- T + — » G/MT with fiber 
T+/T. There is a natural action ofGxT on G/M x T T + given by 

(G x T) x (G/M x T T+) -> G/M x T 7~+, ((#, £), [aM, a]) i-> [52M, at] . 
The next lemma gives us basic structural information on S + . 
Lemma 2.4. XTie set S + zs open in S = Gc/McNc. Moreover, the mapping 

$ : G/M x T r + ^», [#M, t}^ gt- £ 
is a G x T-equivariant biholomorphism onto S+. 

Proof. Clearly, $ is a defined G x T -equivariant map with im <I> = S + . By the definition of the complex 
structure of G/MT the holomorphicity of the map is clear, too. Let us show that <& is injective. For that 
assume that giti ■ £ = g 2 t 2 ■ £oi 9j G G, f 3 - 6 T + . By G-equivariance we may assume that g 2 = 1. Then 
gi G G (~1 Pc = MT and w.lo.g. we may assume that g\ e M. Consequently, as 7c H M^Nc = T, we 
obtain £i 6 £2T, i.e. [M, £i] = [M, £2]- Hence $ is injective. 

A standard computation yields that d<& is an immersion and a simple dimension count shows that 
dim G/MT + dim 7+ = dimS. In particular, $ is a submersion and im<f> = S+ is open, concluding the 
proof of the lemma. □ 

2.1. Fiberings. To conclude this section we mention three natural fibrations in relation to 2+ and F+. 
Write S + = exp(s + ) and recall that the map 

Y = G/K -> G C /K C S+, gK h- gK c S+ 

is a G-equivariant open embedding. Henceforth Y will be understood as an open subset of the flag 
manifold G C /K C S+. 

Lemma 2.5. The following assertions hold: 

(i) The natural map 

E+^F+, zM c N c h-> zP c 

is a holomorphic fibration with fiber T+/Y . 

(ii) The natural map 

F+ -> Y, gMT 1 ► gif 

is a holomorphic fibration with fiber the flag variety K /MT . 

(iii) The natural map 

S + ->Y, gt-^ Q ^ gK 
is a holomorphic fibration with fiber K/M x ^ 7+ . 
Proof, (i) follows from G H Pc = MT and (ii) is obvious. Finally (iii) is a consequence (i) and (ii). □ 



HOROSPHERICAL MODEL FOR DISCRETE SERIES 



7 



3. The G x T-Frechet module 0(2+) 

The natural action of G x T on 2+ gives rise to a representation of G x T on the Frechet space 0(2+) of 
holomorphic functions on 2+. We will decompose 0(2+) with respect to this action. By the compactness 
of T, it is clear that 0(2+) decomposes discretely under T. It turns out that each T-isotypical component 
is the section module of a holomorphic line bundle over the flag domain F + and that all such section 
modules arise in this manner. 

In the second part of this section we turn our attention to G x T-invariant Hilbert spaces of holomorphic 
functions on 2+. By definition these are unitary G x T- modules TL with continuous G x T-equivariant 
embeddings into 0(2+). There are many interesting examples such as weighted Bergman and weighted 
Hardy spaces. We will discuss the Hardy space 7i 2 (2+) on 2+ with constant weight and show that 
7i 2 (2+) constitutes a natural model for the the iJ-spherical holomorphic discrete series of G. 

3.1. The decomposition of 0(2+ ). In Section|21we exhibited a natural action of G x T on 2+, namely 
(3.1) (GxT)x 2+^2+, ((g,t),Q~g-S-t . 

We recall that 0(2+) becomes a Frechet space when endowed with the topology of compact convergence. 

Remark 3.1. Finite dimensional representation theory of Gc shows that H (and hence 3+) is holomor- 
phically separable. In particular 0(2+) ^ {0}. 

Denote by GL(0(2+)) the group of bounded invertible operators on 0(2+). 
The action H3.1(l induces a continuous representation of G x T on 0(2+): 

L ® R : G x T - GL(0(2+)), ((L ® R)(g, t)f) (£ = fig' 1 • £ • r 1 ) , 
(<?,*) GGxT, / e 0(2+), and £ e 2+. _ 

We first decompose 0(2+) under the action of the compact torus T. Denote by T/T the character 
group of T/T, i.e. T/T = Hom cont (T/r, S 1 ). In the sequel we identify T/T with the lattice 

A = {A G o* I Vf7 e (exp |t) _1 (r) X(U) e 2niZ} . 
Explicitly, to A £ A one associates the character xx(tT) = e^ logt \ Often we will write t x for x\(tT). 
The assumption that Gc is simply connected allows an uncomplicated description of the lattice A. 



Lemma 3.2. A = |a g a* | (Va e A) G z|. 



Proof. " C": Let A £ A. We first show that £ Z for all a G A^. For that observe that the compact 

symmetric space K/H n if embeds into G/H via the natural map 

K/H C\K G/H, k(H n K) ^ kH . 
Thus 8 1, Ch. V, Th. 4.1, yields that G Z for all a G A fe . To complete the proof of " C" we still 

have to verify r^~\ G Z for all a G A n . Fix a G A n . Standard structure theory implies that there is an 



embedding of symmetric Lie algebras (su(l, l),so(l, 1)) — » (g, f)) such that 



i 
-i 



G su(l, 1) is mapped 



to ia G t. As Gc is simply connected, we thus obtain an immersive map SU(1, l)/SO(l, 1) — » G/H. In 
particular, r'^ G Z must hold. 

" D": Suppose that G Z holds for all a. Recall the extension t C c of t to a compact Cartan 

subalgebra of g. In the sequel we consider A as an element of c* which is trivial on cfl f). On p. 537 in 
it is shown that A is analytically integral for G = expc (again this needs that Gc is simply connected). 
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In particular A defines an element xa € T. It remains to show that xa|t = 1. As M = Zhdk (a) and 
r = M n T, this reduces to an assertion on the compact symmetric space K/H n K, where it follows 
from 8 1, Ch. V, Th. 4.1. □ 

For each A £ A define the A-isotypical component of 0(S+) by 



(3.2) 0(S+) A = {/ e 0(H+) | (Vi 6 T) JZ(i)/ = t A /} • 

As (i?, 0(S_|_)) is a continuous representation of the compact torus T on a Frechet space, the Peter- Weyl 
theorem yields 

(3.3) 0(S + ) = 00(S + ) A 

AeA 

Each 0(E + )\ is a G-module for the representation L. In order to describe them explicitly we recall 
some facts on holomorphic line bundles. 

For A € A we write C A for C when considered as a MT-module with trivial M-action and T acting 
by xx- Recall that G/MT inherits a complex manifold structure through its identification with the flag 
domain F + . In particular, to each A £ A one associates the holomorphic line bundle 

(3.4) £ A = Gx MT C_ A . 

Write 0(C\) for its G-module of holomorphic sections, i.e. 0(C\) consists of smooth functions / : G — > C 
such that 

• f{gmt) = t~ x f(g) for g G G, t <E T and m <E m. 

• G/MT -> C\, gMT i-> [ ff AfT, f(g)} is holomorphic. 

The restriction of C\ to the flag variety K/MT yields the holomorphic line bundle 
over K/MT. Write Aq for the A^-dominant elements of A, i.e. 



(3.5) A = { A e A | (Va e A+) (A, a) < 0} . 

According to Bott [L, Va = C(/C A ) is of finite dimension, and non-trivial if and only if A 6 Ao. By 
£\ = G Xmt C_a -Gxjf (iT Xmt C^ A ) we retrieve the standard isomorphism 

0(£ x )~0(Gx K V x ). 

In particular, 

(3.6) O(£ A )^{0} AeA . 

We remind the reader that the T- weight spectrum of ir\ is contained in A + Z> [A + ]. In particular, 
0(£\), if irreducible, is a lowest weight module for G with respect to the positive system A + and lowest 
weight A. 

Finally we establish the connection between C(S + ) A and 0(£\). For that let us denote by So the 
pre-image of F + in 3, i.e. 

S = GT C ■ £o • 

Notice that S + c So. Holomorphicity and T-equivariance yield C(S+) A = C(So)a- Likewise holds for 
0{£\). Thus holomorphic extension and restriction gives a natural G-isomorphism C(S+) A — 0{£\). 
We summarize our discussion. 
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Proposition 3.3. The G x T-Frechet module 0(5+) decomposes as 

0(3+) = 0(5+) A . 

AeA 

Moreover, holomorphic extension and restriction canonically identifies 0(5+ ) A with the section module 
0(£ A ). 

We conclude this subsection with some comments on unitarization of the section modules 0{C\). 

Remark 3.4. Let A 6 Ao and let us denote by 0(£\) K ~ Rn the (g, if)-module of Jf-finite sections of 
0{C\). Let us assume that 0(C X ) K - Rn is irreducible. Then 0(£ A ) K - fin identifies with the generalized 
Verma module A(A) = U(qc) ® u r$ c+s -\ V\ and the Shapovalov form on N{\) gives rise to the (up to 
scalar unique) contravariant Hermitian form on 0(£ A ) K - fin . We say that 0(£ A ) K ~ fin is unitamzable 
if the Shapovalov form is positive definite. Another way to formulate it is that there exists a unitary 
lowest weight representation (7r A ,7i A ) such that the (g, -fQ-module of if-finite vectors TL^ &n is (g,K)- 
isomorphic to 0(£ A ) K ~ fin . In this situation 0(£ A ) is then naturally G-isomorphic to the hyperfunction 
vectors W A " of 7r A . 

We want to emphasize that not all A G Ao correspond to unitarizable modules 0(C\) K ~ tin (a necessary 
condition is A|n > and we refer to j2] for more precise information). However, we want to stress that 
0(£ A ) K ~ fin is automatically unitarizable if A|n is sufficiently positive (for example if condition H3.12[) 
below is satisfied). 

3.2. The Hardy space on S+. The objective of this section is to introduce the Hardy space on 5+ and 
to prove some of its basic properties. 

We begin with some measure theoretic preliminaries. The groups Gc and MqNc are unimodular, and 
hence 3 = Gc/McNc carries a Gc-invariant measure \i. 

Recall that M is a compact subgroup of G and denote by dm a normalized Haar measure on M. 
Further we let dg and d(gM) denote left G-invariant measures on G, resp. G/M, normalized subject to 
the condition 

/ /(<?) dg = [ f f(gm) dm d(gM) 
Jg Jg/m Jm 

for all / G L l (G). 

Notice that the stabilizer in G of any point (eT + -(o C 5+ is the compact subgroup M, In particular 
one has 

(3.7) / f(g-Odg= [ f(g-Od(gM) 

Jg Jg/m 

for all £ G 7+ • £o and integrable functions / on 3+. 

Write || • ||2 for the L 2 -norm on L 2 (G). Let us remark that the representation (R, 0(3+)) of T naturally 
extends to a representation of the semigroup t G 71 UT, also denoted by R. Furthermore if / G 0(3+) and 
t G T_ then we can define the restriction of R(t)f to G by R{t)f\ G : G -> C by R(t)f\ G (g) = /(gt^ 1 ■ 
The Hardy norm of / G 0(5+) is defined by 

(3.8) ll/H 2 = sup f \f(gt ■ £o)| 2 dg = sup ||i*(i)/| G ||| . 

teT + Jc teT- 

Let 

(3.9) ft 2 (S+) = {/ G 0(5+) I 11/11 <oo}. 
Obviously 

(3.10) \\R(t)f\\ < 11/11 foraUtGT_ 
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and hence 71 acts on 7i 2 (S+) by contractions. Note, that R(t)f\c is right M-invariant, and, by the 
definition of the Hardy space norm R(t)f\ G G L 2 (G/M) C L 2 (G). 

Lemma 3.5. The space 7i 2 (S + ) is a Hilbert space. Furthermore, the following holds: 

(i) For £ G S + the point evaluation map evj : 7Y 2 (S + ) 9 / i— » /(£) G C is continuous. 

(ii) TTie boundary value map (3 : H 2 {Z + ) -> L 2 (G/M) C L 2 (G) 

/?(/) = lim i?(i)/| G 

is an isometry into L 2 (G/M). 

Proof. The proof follows a standard procedure and will be more a sketch. We refer to JT], in particular 
the proof of Theorem 2.2, for a detailed discussion of the underlying methods. 

Let £ G S_|_. Then there exist relatively compact open sets Uq C G and Ut Q 7+ such that £ G 
UqUt ■ £o- Thus, there is a constant c > such that the Bergman-type estimate 

/ l/(0l 2 dM(0<c-||/ll 2 

holds for all / G 7i 2 (S + ). This implies that 7Y 2 (S + ) is complete, and that point evaluations are continu- 
ous. 

Write C+ = {z G C Im(z) > 0} for the upper half plane and fix Z G ift. We notice that the map 
T_ 3 in R(t)f\c G L 2 {G) is well defined and holomorphic. Hence 

L f : C+ -> L 2 (G/M); L f (z) = R(exp(zZ))f\ G G L 2 (G/M) 

defines a holomorphic function on C+. 

By Lemma 2.3 in 1 1 II it follows, that lim z _>o Lf(z) exists, and is monotonically increasing as s \ 
along each line segment exp(siZ), or, because of the right invariance oidg, on each te~xjp(siZ), t G T. As 
in |TJ, one shows, that this limit is independent of Z. Thus, we get a boundary value map (3 : 7i 2 (S + ) — > 
L 2 (G/M), defined by 

j 9(/) = limi2(t)/| G . 

By the definition of the Hardy space norm, we obviously have 

Mf)b< 11/11 ■ 

But, as the norm ||i?(exp(sZ))/|| 2 is monotonically increasing for s \ 0, it follows that 

||i?(exp(,sZ))/|| 2 < \\P(f)\\ 

for all s G M+. Thus 

||i?(*)/| G ||<||/3(/)||. 

It follows, that (3 : 7i 2 (S + ) — > L 2 {G) is an isometry, and hence 7i 2 (S + ) is a Hilbert space. □ 

Clearly L ® R defines a unitary representation of G x T on 7i 2 (S+). We are going to decompose 
7Y 2 (S+) with respect to this action. As before we begin with the decomposition under T. For A G A the 
A-isotypical component of 7i 2 (S+) is given by H 2 (E + )\ = 7i 2 (S + ) n 0(E + )\. The Peter- Weyl theorem 
yields the orthogonal decomposition 

(3.11) H 2 (E + ) = H 2 (~ + ) x 

AeA 

of H 2 (S+) in G-modules. 

We draw our attention to the unitary G-modules H 2 (E + )\ inside of 0(E + )\. 



HOROSPHERICAL MODEL FOR DISCRETE SERIES 



11 



Suppose that H 2 (z.+ )\ ^ {0}. Then 0{L\) ^ {0} and the restriction mapping 

gives a G-equivariant embedding. Moreover /3(7Y 2 (S + ) A ) C L 2 (G). Thus 7i 2 (S + ) A is a module of the 
holomorphic discrete series of G. In terms of A this means that A satisfies the Harish- Chandra condition 

13 

(3.12) (A-p(c),a> >0 (Vae£+), 

where p(c) = \ £ QeS+ a - 

Write A s d for the set of all A G Ao which satisfy (|3.12|) . 

Conversely, let A £ A s d and write H.\ for a corresponding unitary lowest weight module with lowest 
weight A. Denote by v\ G H.\ a normalized lowest weight vector and write d(X) for the formal dimension 
(see |7] or (|5.13|l below). It is then straightforward that 

n x -> w 2 (s + ), v » (gt ■ Co ^ \/rf(Ay ■ t- x (-K X {g- l )v, v x )) 

defines a G-equivariant isometric embedding. Hence H 2 (E + )\ ~ H\ 7^ {0}. 

Summarizing our discussion we obtain the Plancherel decomposition for 7i 2 (S + ). 

Proposition 3.6. As a G-module the Hardy space decomposes as 

n 2 (E + )^ h x . 

AeA 3d 

Remark 3.7. (a) The set A s( j describes the set of all ii-spherical unitary lowest weight representations 
(up to equivalence) whose matrix coefficients are square integrable on G, i.e. A s( j is the spectrum of the 
ii-spherical holomorphic discrete series of G. 

(b) Later we well mainly deal with the spectrum A2 of the holomorphic discrete series on X . One has 

A 2 C A sd 

with equality precisely for the equal rank cases |201 |2*T] . 

4. Complex Horospheres II: Horospheres with no real points 

We continue our discussion of complex horospheres from Section [5] We will introduce the notion of 
horosphere without real points and investigate S + with respect to this property. In addition we will 
prove some dual statements for the minimal tubes D±. 

Definition 4.1. We say that the complex horosphere E(£) C Xc has no real points if E(£) DX = 0. We 
denote by S nr C S the subset of those £ which correspond to horospheres with no real points. 

Lemma 4.2. The set S„ r is a G-invariant subset o/S. 

Proof. Let £ £ S nr and g G G. Assume, that x G E(g ■ £) n X. Then g~ x x G E(£) D X, contradicting the 
assumption that E(£) has no real points. □ 

Recall the open G-invariant subset S + = GA + ■ ^ C S. In the sequel it will be useful to consider with 
S + its pre-image S + in G . i.e. 

S+ = GA+M C N C • 

It is clear that S + is a left G and right McNc invariant open subset of Gc- 

Next we draw our attention to the Zariski open subset NcAcHq of Gc- Our objective is to study 
in relation to NcAcHc- 
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Remark 4.3. Notice that S^ 1 C NcAcHc is equivalent to G C NcAcHc- However the latter is true 
only for rank AT = 1, i.e. dimt =1. In general, G n NcAcHc is an open and dense subset of G (cf. 
Theorem 14.51 below) . 

There is a right He and left A^-invariant holomorphic middle-projection 

a H : N C A C H C -> A c /T, z i-> a ff (a:) 

In particular, for each A 6 A we obtain natural (iVc, i?c) _m variant holomorphic maps 

N C A C H C -» C, x ^ a H (x) A . 

The holomorphic function iVcAc • a^o ~~ * Ac/T induced by shall also be denoted by a#. 
The function a# enables us to give a useful geometric description of horospheres. 

Lemma 4.4. Let £ = g ■ £q G S /or a. G G?c- 27ien 

B(0 = {zex c l^-^eTVcAc-xo, a // ( ff - 1 z) = r} 

= {z e I c £ Ac Ac • £o, a H (g~ 1 z) x = 1 /or A e A} 

Proof. " C": If z G -E^), then z = gn ■ x for some n G iVc. Thus <7 z = ?i • £o G AfcAc • %o and 
a H (g^ 1 z) = a H (n ■ x ) = T. 

" D": Conversely, let z G Xc be such that g~ 1 z G ATcAc ■ xq and a#(<? _1 z) = T. ^From the first 
condition follows that g~ 1 z = na ■ xq for some n G Ac and a G Ac; the second condition implies a G T. 
Thus z G <7 ■ £cb as was to be shown. □ 

We define a subset of A by 

(4.1) A> = {A G A | A| > 0} 

(4.2) = { A G A | A| n > 0, (Va G A+) (A, a) < 0} . 
The following theorem is the main geometric result of the paper. 

Theorem 4.5. The following assertions hold: 

(i) G fl NcAcHc is open and dense in G. 

(ii) Let A G A>o- Then the function a H \GnN c A c H c extends to a continuous function on G and 

\a H (g) x \<i (geG). 

Proof. The approach to prove this theorem lies in the use of the structural decomposition 

(4.3) G = KA q H 

where A q — exp(a g ) with a q C 5 (~1 q a maximal abelian subspace. There is a natural way to construct 
a flat a q out of the weight space decomposition gc = + trie + © qG a 0c- ^ wm ^ e briefly reviewed. 
Let 71, . . . ,7 r G A+ be a maximal set of long strongly orthogonal roots. Then one can find Zj G 0^ , 
j = 1, . . . , r, such that 

r 

(4.4) o 9 = 0R(Z,--r(Z i )) 

is a maximal abelian subspace of s n q; further 

(4.5) A q c 5 + A7F c 

(see HO], p. 210-211 for all that). 

(i) As 5+ C N c , we obtain from l|4.3jl and H4.5j> that 

G G .V; l\A~ll . 
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Hence it is sufficient to show that 



(4.6) KA- n N+A C (H C n K c ) is open and dense in KA- 

To continue, we first have to recall some facts related to the Iwasawa decomposition of Kc- Write 
Ng f° r a maximal C-stable unipotent subgroup of Kc containing Nj£ and set A = exp(zc). Then 
Kc = N^AK is an Iwasawa decomposition of Kc- We recall that f2 and hence A- is Wfc-invariant. Thus 
Kostant's non-linear convexity theorem (cf. Ch. IV, Th. 10.5) implies that KA_ C NjjtA-K. As 
iV+ C N£M c and AC AC AM C , we thus get KA~Z C N^A~ZM c K. In particular, in order to establish 
(14.61) it is enough to verify that K n N£Ac(Hc f~l Kc) is dense in K. But this is known (for example it 
follows from Lemme 2.1 in 0). 

(ii) In the proof of (i) we have seen that G C NcMcA-KHc- Thus we only have to show that can 
be defined as a holomorphic function on Kc with \an(ak) x \ < 1 for all k G K and a G ^4_. For that let 
(t\, V\) denote the holomorphic (He f~l Ac)-spherical representation of Kc with lowest weight A. Write 
(•, •) for a if-invariant inner product on V\. Let v\ be a normalized lowest weight vector and vh be the 
spherical vector with (vh, v\) = 1. Then for all x G N^Ac(Hc f~l Kc) C Kc we have 

(tt x (x)v h ,v x ) = a H (x) x . 

As the left hand side has a holomorphic extension to Kc, the same holds for a^. Finally, for a G A- and 
k C K we have 

a H (ak) x = a x a H {k) x . 

Observe that a x < 1 as A G A>o and that \an(k) x \ < 1 for &\\ k £ K by Lemma 2.3 in [2]. This completes 
the proof of (ii). □ 

Theorem 14.51 features interesting and important corollaries. 

Corollary 4.6. Let A G A> 6e sucft tftai A|n > 0. TTien a^|g-i 

nJV C j4 c Hc extends to a holomorphic 

function on S^ 1 with 

\a H (x) x \<i Ores; 1 ). 

Corollary 4.7. S + C H nr , i.e. E(g) C\ X = $ for all £ . 

Proof. Suppose that there exists £ C S + such that E(£) fl AT 7^ 0. In other words S + n i?c 7^ < ^=> 
S; 1 n i?c 7^ ; a contradiction to the previous corollary. □ 

Remark 4.8. (Monotonicity/Convexity) Theorem l4.5l (ii) has a natural interpretation in terms of con- 
vexity/monotonicity. Write pr a = Slogan and note that pr a : AcAc-ffc — > a is a well defined continuous 
map. Theorem 14.51 (ii) is then equivalent to the inclusion 



(4.7) P v a (GnN c A c H c )C 



i>o ■ a. 



4.1. Dual statements for the minimal tubes. Recall from Subsection 11.11 the minimal tubes D± 
GA± ■ xq in Ac with edge X. 

It follows from Neeb's non-linear convexity theorem that 

(4.8) GA^ C N C M C A-G . 
This fact combined with Theorem 14. 51 yields 

(4.9) GA^H C n N C A C H C C N C TA^ exp M> • a J H c - 

Wa+ / 
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We have shown: 

Corollary 4.9. Let A 6 A> be such that A|q > 0. Then, a^j \D-nN c A c -x extends to a holomorphic 
function on _D_ such that 

\a H (x) x \<l (xGD_). 

We recall the definition of the orbits S(z) C 3 for z e Xc (cf. equation I2.3[l . The convexity inclusion 
(|4.9() delivers the dual statement to Corollary 14. 71 

Corollary 4.10. S(z) n G/M = for all z efl_. 

Proof. Let z = ga • xo for 5 e G and a G A_. Suppose that S(z) H G/M ^ 0. As S*(z) = <?aifc • Co, this 
is equivalent to aHcNc fl G 0. In other words Ga fl iVc-ffc 7^ 0; a contradiction to (|4.9|) . □ 

Remark 4.11. Note that l|4.8|l is equivalent to A + G C GAfAfciVc. This inclusion exhibits interesting 
additional structure of S + ; it implies 



(4.10) S+ = GA+G • Co • 

Remark 4.12. (Generalization to other cones) Let be a Wfc-invariant convex open sharp cone in a 
containing fl. A particular interesting example is the maximal cone (denoted by c max in |10|L In this 
context we would like to mention that the results in this section remain true for f2 replaced by f2, the 
obvious adjustment of A>o understood. 



5. The horospherical Cauchy transform 

Our geometric results from Section 4 enable us to define a natural horospherical Cauchy kernel on H+. 
The kernel gives rise to the horospherical Cauchy transform L}{X) — > C(S + ). The main result is a 
geometric inversion formula for the horospherical Cauchy transform for functions in the holomorphic 
discrete series on X . 



5.1. The horospherical Cauchy kernel. In this subsection we define the horospherical Cauchy kernel 
and the corresponding horospherical Cauchy transform. We will introduce the holomorphic spherical 
Fourier transform and relate it the horospherical Cauchy transform. 

To begin with we have to recall some features of the root system A. Let us denote by 

II = {oti, . . . , a m } 

a basis of A corresponding to the positive system A+ U A^T. As Spccad(Zo) = { — 1, 0, 1}, it follows that 
exactly one member of LI is non-compact, say a m . Define weights u>\, . . . , uj m 6 a* by 

(cOi,a.j) 

T^-A=5ij (l<i,j<n). 

Set 

A>o = ^>o • wi + . . . + Z> • Lo rn -i + Z >0 • ui m . 
Recall the definition of A>o from 14. 1|) . 

Lemma 5.1. The following assertions hold: 

(i) Wj|n > for all 1 < i < n. In 'particular, A|n > for all A £ A>o- 

(ii) A> = Z> ■ u>i + . . . + Z> • u> m . In particular, A >0 C A> . 
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Proof, (i) Fix x £ fl. Then x = X)aeA+ ^ Q< ^ with fc Q > 0. Now each a £ A+ can be uniquely expressed 
as a = a m + 7 with 7 G Z>o[A~]. Moreover if a = /? is the highest root, then 7 € Z>o[ai, . . . , a„_i]. As 
kp > 0, the assertion follows. 

(ii) Set A' >0 = Z> • u)\ + . . . + Z> • w m . We first show that A' >0 C A> . For that let A G A' >0 , say 

A = YliLi ki^i with ki £ Z>o. As ari, . . . , a„_i constitutes a basis of A - , it follows that 6 Z< for 

all a G AT. Furthermore, A|n > by (i). Hence A' >0 C A>o- 

Finally we establish A> C A' >0 . For that fix A G A>o- Then A = YlTLi k't^i with some real numbers 
ki. We have to show that ki G Z>o- Now A G A>o means in particular that G Z<o for all a G A^. 

Hence ^.'"V^ G Z>o for all 1 < i < re — 1. It remains to show that ^ A '°J*^ G Z>o- Integrality is clear. 
Also since R>o • ct m constitutes a boundary ray of the cone f2, non-negativity follows. □ 

Define the horospherical Cauchy kernel on S + as the function 

1 771-1 1 

In view of Corollary 14. 61 and Lemma l5.1lT ). the function /C is holomorphic, left _ff-invariant and bounded 
on subsets of the form GU ■ £0 for U C A + compact. 

This allows us to define for a function / G L 1 (X) its horospherical Cauchy transform by 

/(0= / f{x)-K{x- l H)dx KeE+). 

We notice that the horospherical Cauchy transform is a G-equivariant continuous map 

L 1 (X)^0(S+), /-/. 

Remark 5.2. (a) The horospherical Cauchy kernel JC is tied to the geometry of the minimal cone f2: 
there is no larger Wif-invariant open convex cone VL such that /C would be holomorphic on Gexp(fi) ■ £0 
(this follows from Lemma fo.ll and p.2|l ). In this context we wish to point the difference to the results of 
Section 0] which are valid for a wider class of convex cones (cf. Remark 14. 1211 . 
(b) For each A G A and £ G S + consider the complex hypersurface 

L(A,0 - {z G X c 1 Mr 1 *)* -1 = 0} 

in Xc- Their intersection is and they do not intersect X. The singular set of the horospherical 

Cauchy kernel is the union of the m hypersurfaces L{uji, A) and the edge of this set is just E(£). It means 
that if / is boundary value of a holomorphic function on D + then / is a residue on E(£). 

The horospherical Cauchy transform can be decomposed in its constituents associated to the elements 
A G A >0 . More precisely, for A G A >0 and / G L X {X) let us define fx G 0(E + ) by 

fx(0 = I f(x)-a H (r 1 x) x dx. 
Jx 

We will call the map A 1— > fx G 0(3+) the spherical holomorphic Fourier transform of f. 

Lemma 5.3. The following assertions hold: 

(i) Let U C A + be a compact subset. The series 

£ a H {C l ) X (£GS + ) 

AeA >0 

converges uniformly on GU ■ £0 C S + . 
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(ii) For all £ G S+ one has 

E aniC^^m) 



AeA> 

Proof. Uniform convergence on GU ■ £o is immediate from Corollary 14.61 and Lemma 15.11 Summing up 
the geometric series one obtains 

oo oo 

E a *(cV E E a H {c l ) k ^ + - +k — 

AgA >0 fci = ...=fc m _i=0 k m = l 

- 1 



i - Mr 1 )"- V JJ i - Mr 1 ) 1 ^ 



i n ! 



□ 



We conclude from Lemma 15.31 that the horospherical Cauchy transform of a function / G ^(X) can 
be decomposed as 

/= E A 

AeA >0 

with the right hand side converging uniformly on compacta. 

Remark 5.4. We wish to point out that the horospherical Cauchy kernel is a product of geometrical 
and not functional analytic reasoning. We emphasize that in general not all parameters A 6 A>o in the 
decomposition of the horospherical Cauchy kernel correspond to unitarizable lowest weight modules (see 
Remark 15 .61 below for a more detailed discussion). 

5.2. Holomorphic Fourier transform on lowest weight representations. The objective of this 
subsection is to give a more detailed discussion of the holomorphic Fourier transform for functions / G 
L 2 (X) which are contained in lowest weight module. 

To begin with we collect some material on spherical unitary lowest weight representations. A reasonable 
source might be the overview article |16| . 

Let (tt\,TC\) be a non-trivial 7J-spherical unitary lowest weight representation of G. As before we 
denote by v\ a normalized lowest weight vector. Write vr for the unique iJ-fixed distribution vector 
which satisfies (v\,vji) = 1. 

We record the fundamental identity 



(5.1) a H (x) x = (7r x (x)v H ,v x ) (x G X) , 

which allows us to link our geometric discussion in Section 0] with representation theory. 

Remark 5.5. It follows from Corollary 14.91 that a^- admits a holomorphic extension to the minimal 
tube Traditionally this fact was explained via (|5.1|l in the context of holomorphic extension of 

unitary lowest weight modules (see ^B])- We wish to point out that Corollary 14.91 asserts more, namely 
that o^\d_ is bounded by 1. In addition Corollary 14. 91 is more geometric, i.e. not restricted to unitary 
parameters A. 
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Pairing the G-module of smooth vectors with vh yields the G-equivariant embedding 

(5.2) L : HT -» C°°(X), v^(x^ (^(aT 1 )*, v„)) . 

We say that tt\ is X -square integrable if there exists a constant d s (X) > 0, the spherical formal dimension 
(cf. jl4|). such that y/d s (X) ■ t extends to an isometric map 7i\ — > L 2 (X). 
X-square integrable parameters A are characterized by the condition |21j 

(5.3) (A - p, a) > for all a G A+ . 

Here p = | J] a eA+ TO " a witn TO « = dim c 9c- 

Likewise we say n\ is X -integrable if n ) C ^(X). Integrability is described by the inequality 

(5.4) (A - 2p, a) > for all a G A+ . 

The set of parameters A G A>o which satisfy condition Ij5.4|l . resp. (|5.3|1 . shall be denoted by Ai, resp. 
A 2 . Note that Ai C A 2 . 

Remark 5.6. We will discuss the lattice A>o with regard to Ai and A 2 . One recognizes a strong 
dependence on the multiplicities m a which we will exemplify for three basic cases below. Recall that 
elements A G A>o are described by A = 53j=i ^i^i with A^ G Z>o and A m > 0. In addition let us keep in 
mind that conditions l|5.3l) and l|5.4|l are equivalent to (A — p, a m ) > 0, resp. (A — 2p, a m ) > 0. 

The equal rank case: In this situation one has t = c and m a = 1 for all a. Thus p = \ Ylj—i u>i and 
therefore A — p = J^ i=1 (Aj — |)k>i. In particular (A — p, a m ) — (a m , a m )(X m — |) and thus A>o C A 2 as 
A m > 1 for elements A G A >0 . 

The group case: In this situation one has m a = 2 for all a and so p = X)j=i ^i- Accordingly we obtain 
(A — p,a m ) = {a m , a m )(\ m — 1). It follows that A>o parameterizes the holomorphic discrete series and 
their limits; in particular A 2 C A>o. 

The rank one case: Here one has A>o = Z>o • w and p = ^f-ct- Thus A 2 = (Z>o + [^])oj and 
A 2 C A>o with equality precisely for m a = 1, i.e. g — s[(2,R). 

For A G A 2 we set L 2 {X) X = l(H\). 

Lemma 5.7. Let A, p G A 2 . Fix v G TL\ and define f(x) = (it\(x~ 1 )v,vh) G L 2 (X)\. Then for all 
£ G 3_|_, the function 

X^C, x^ f{x)a H {C 1 xY 

is integrable and 

(5.5) J f(x)a H (C 1 xr dx = ^-(v, 7r A ®« A ) . 
Here 

tta(£) w a = a~ X TT\(g)v\ G TL\ for £ = ga ■ £0, g G G and a G A + . 
Proof. Fix £ G S+. Holomorphic extension of (|5.1|) yields 

for all g G G and £ G H+. It follows that 2; 1— » oh-^ -1 :?;)^ is square integrable on X. Thus a; 1— > 
f{x)aH{£,^ 1 xY is integrable. Finally we apply Schur-orthogonality (cf. 14 , Prop. 3.2) and obtain 
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f(x)a H (£, 1 x)^dx = / (ir\(x 1 )v,v^ i ){-k i1 (x)v'^,-k i1 (O v h) dx 
x Jx 



(ttx(x )v,v h )(-k^{x l )-K^)v IJl ,v l ^)dx 

X 

" A 'v,-k\(£)v\) . 



da (A) 

□ 

For A e Ai let us write L 1 {X)\ for the closure of i(7i^ _fin ) in L 1 (X). The next lemma can be 
understood as an inversion of Schur-orthogonality for the Cauchy-transform. 

Lemma 5.8. Let A € Ai. Then 

f = h for all f€L l (X) x . 

Proof. Fix / G L l (X)\. We have to show that J M = for all p G A >0 \{A}. For p G A 2 this is a 
consequence of Lemma 15.71 Therefore, we may assume that p G A>o\A2. It means that condition 15.311 
is violated which we will express as 

(5.6) (fl-pjOm) < 0. 

We now show that 

MO = I f(x)a H (C 1 xr dx = for all £ G S + . 
Jx 

Equation above has boundary values on G/M C 9S + and it will be sufficient to prove that 
U(gM) = f f{x)a H {g' 1 xY dx = for all g G G. 



x 



We compute 



x 



X 



U(gM) = I J{x)a H {g' 1 xY dx 
f(gx)a H {xY dx 

f(tgx)aH(tx) fJ ' dx dt 
t fl f(tgx)dt) a H {xT dx. 



T JX 



X 

To arrive at a contradiction, suppose that J T t^f(tgx) dt ^ 0. This can only happen if p belongs to the 
T- weight spectrum of ir\. Now the T- weights of ir\ are contained in A + Z>o[A + ]. Thus p = A + 7 for 
some 7 G A + . But then 

(p - p, a m ) = (A - p, a m ) + (7, a m ) . 
Observe that both summands on the right hand side are positive, the desired contradiction to (|5.6|) □ 

Remark 5.9. (Analytic continuation) Let A G Ai and / G L 1 (X)\C\L 2 (X)\. Write f(x) = (tt\(x~ 1 )v, vh) 
for some v G TL\. Then Lemma 15.71 and Lemma 15.81 imply 

(5-7) ^ ^ d^Xj {v ^ x ^ )vx) ■ 
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Clearly, the right hand side makes sense for all v G H\ and all AT-square integrable parameters A G A2. 
We now explain how passing to parameters A € A2 in 1(5. 7|) has a natural explanation in terms of analytic 
continuation. For that let G denote the universal cover of G. Write Ai, A2 for the sets of G- integral 
parameters which satisfy 1(5.4(1 . resp. 1)5.3(1 . Clearly Aj.,2 C Ai^. The effect of passing to the universal 
cover is that the parameter spaces involved become continuous in the central variable, i.e. there exists 
constants < c-i < c\ such that 

Ai|ez =]ci, oo[-(a m |]Rx ) and A 2 |rz =]c2, oo[-(a m \s.z ) ■ 

By the concrete formula for d s (X) from 14 , Th. 4.15, we know that A 1— > d s (X) is a meromorphic 
function on a£ which is positive on A2. Now familiar techniques show that that the assignment A2 9 
A 1 ► d jj* (v, ft\(£,)v\) G C becomes analytic in the central variable (the Shapovalov form is polynomial 
in A and in |13| it is explained how to make consistent analytic choices for v and v\ in dependence of the 
central coordinate of A). 

Motivated by Remark 15.91 we define the horospherical Cauchy transform for functions / 6 L 2 (X)\, 
A G A 2 by 

7= fx- 

5.3. Hyperfunctions and generalized matrix coefficients. In order to discuss the horospherical 
Cauchy transform and its inverse in a more comprehensive way we need some results on the analytic 
continuation of generalized matrix coefficients of lowest weight representations. Proofs of the facts cited 
below can be found in |15j . 

Let (77, H) be a unitary lowest weight representation of G. Write TL^ and Tl~ u for the associated 
G-modules of analytic, resp. hyperfunction vectors. The nature of the T-spectrum of 7r shows that tt\t 
extends holomorphically to 71. Moreover the so obtained self adjoint operators 7r(a), a G A-, are of 
trace class and strongly mollifying, i.e 

(5.8) n{a)H- u CM" (a G A_) . 

Assume that 7r is ii-spherical and denote by vh the (up to scalar) unique iJ-fixed distribution vec- 
tor. Let v G 7i~" be a hyperfunction vector. We wish to interpret the generalized matrix coefficient 
f(x) — (tt(x^ 1 )v,vh) as a generalized function on X = G/H. It follows essentially from (|5.8|l that the 
prescription 

(5.9) f(ga ■ xo) = {ir(g~ 1 )n(a~ 1 )v, vh) for g G G and a G A + . 

defines a holomorphic function on D+ = GA+ ■ xq. The minimal tube D+ has X as edge and this allows 
us to interpret / as the boundary value of /. Henceforth we will identify / with the holomorphic function 
/• 

Suppose that Tt C L 2 (X), i.e. tt — ir\ with A G A2 and H = L 2 (X)\. We now show how the 
horospherical Cauchy transform restricted to L 2 (X)\ can be extended to L 2 (A)^"" C 0(D + ). In other 
words for £ G S + we wish to give meaning to 

f(t) = [ f(x)a H (C 1 x) x dx 

{ir(x~ 1 )v,VH)aH(t~ lx ) X dx 

as a holomorphic function on S+. Express t as t = 9 a ' Co with g G G and a G A+. By the usual 
holomorphic change of variables one obtains that 




20 



SIMON GINDIKIN, BERNHARD KROTZ, AND GESTUR OLAFSSON 



7(0 - / f^auia^g^xf dx 
Jx 

(n(x~ 1 )'K{g~ 1 )'iT{a~ 1 )v,VH)aH{x) X d(x) . 
Now the last expression is well denned by 1)5. 8fl . Of course one has 

(5-10) 7(0 = AyWO^-'K^) 

by the same argument as in Lemma |5. 71 Thus we have shown that the horospherical Cauchy transform 
on L [X)x extends to a G-cquivariant continuous map 

L 2 (X)-^0(Z+) x . 

We conclude this section with a conjecture related to the holomorphic intertwining of 0(D + ) and 
C(S + ). It can be seen as a holomorphic analogue of Helgason's conjecture (actually a theorem ny \V2\). 

In order to state the conjecture some new terminology is needed. Let us call a holomorphic function 
/ on S + bounded away from the boundary if its restriction to gT+a is bounded for all choices of g G G 
and a G A+. We denote by 0b.a.b.(2+) the space of all holomorphic function on S+ which are bounded 
away from the boundary. Note that 0b. a .b.(S+) is a closed G-subspace of the Frechet space 0(S+). 

Conjecture 1. Let Ii{X) be the algebra of G -invariant differential operators on X. Naturally we can 
view H(X) as holomorphic differential operators on Xc- Write 0(D+)\ for the common holomorphic 
J}(X)-eigenfunctions on D + with infinitesimal character A — p. Let A G A2. We conjecture 

(5.11) O b . a , h ,(D + ) x =L 2 {X)-^ . 

Notice that the inclusion " d" is clear by $5.8\) . 

We have already remarked that C(S + )> ~ |15| - Hence our conjectured equality means that the 

horospherical Cauchy transform induces an intertwining isomorphism Oh.&.b.(D+)\ — > C(S + )>. 

It is also interesting problem to formulate ( and prove ) the conjecture for other parameters. 

Remark 5.10. We illustrate Conjecture [I\for the one-sheeted hyperboloid X = Sl(2, K)/SO(l, 1). Fix 
A G 2Z>o = A2 and denote by TC\, resp. Ti-\, the lowest (resp. highest) weight module of G = S1(2,M) 
with lowest (resp. highest) weight A, resp. —A. Denote by Vx-2 the finite dimensional G-module of 
highest weight A — 2. Write C° C (X)\ for the D(X)-eigenspace with eigenvalue A — 1. Then 

Now, the functions of 1~C± X extend holomorphically to D± but not beyond, while the functions of V\-2 
extend holomorphically to all of Xc- One deduces that 0(D + )\ = TL^ © V\-2- Finally, the holomorphic 
functions in V\-i grow exponentially at infinity and hence are not bounded away from the boundary. 
Thus O b .a.b.(£ ) +)A = L 2 {X)^ as conjectured. 

5.4. Inversion of the horospherical Cauchy transform. To begin with we first have to explain 
certain facts on incidence geometry between the Shilov boundary X of D + and the boundary piece G/M 
ofS+. 

We keep in mind that we realized G/M in the boundary of s+ by G/M ~ G ■ £0 C 
Recall the orbits S(z) C S from 12.31 For a point x € X we define the real form of S(x) by 

Sr(x) = S(x) n G/M . 
In view of the incidence relation l|2.4l) . one has 

S R {x) = {£ G G/M I £ G S{x)} = {£ G G/M \ x G • 




HOROSPHERICAL MODEL FOR DISCRETE SERIES 



21 



Lemma 5.11. Let x = g-xo£X,g£G. Then 

S R (x)=gH-£ ~H/M . 

Proof. First notice that for x = g ■ xo with g G G one has S^(x) = g ■ Sr(x ). Hence it suffices to show 
that 

S R (x ) = H ■ Co s H/M . 

Let £ G Sth(xq) and write £ = y ■ £o for some y G G. We have to show that y £ H and that y is uniquely 
determined modulo M. First observe that £ G ^(xo) means yiVc C HcNc and so y € HcNc n G. Now 
HcNc P\G = H implies y E H. Finally, uniqueness modulo M is immediate from Lemma f2. 21 □ 

ft is possible to view the boundary orbits Sr(x) as certain limits. For z = ga ■ xq G £)+ we define 

S m {z)=gaH-to-H/M. 
We note that S-g.(z) C 5 + by 14. f 0|l . Furthermore there is the obvious limit relation 

lim S R (ga ■ £) = 5 K (5 • x ) . 

Write c? z (0 for the measure on Sr(z) which is induced from a Haar measure d(hM) on H/M via the 
identification <Sr(z) ~ H/M . Define the space of fiber integrable holomorphic functions on S+ by 

Ot.i.(E+) = {(j>e 0(E+) \D+3 z-> j |</>(£) | 4(£) is locally bounded} . 
For a function G 0f.i.(S+) we define its inverse horo •spherical transform 4> v G 0(D + ) by 

^(z) = / 0(£) d z (0 (zeD + ). 

J Sr(z) 

We note that 

Of. i.(S+) - 0(D+), </>^0 v 

is a G-equivariant continuous map. 

Finally, we define a subset A c C A2 of large parameters by 

A c = {A G A 2 I (Va G A+) (A - > 2 - m Q } . 
The inversion formula for the horospherical Cauchy transform is based on the following key result. 

Lemma 5.12. Let A G A c . Let f G L 2 {X)^ C C(D+). TTiera / G 0f.i(3+) and 



(5.12) f(z)=d(X)- /(£)4(£) (zeD + ). 

J S s (z) 

Ln other words, f = d(A) ■ (/) v . 

Proof. Let /(.ga ■ £ ) = (^(or^TTA^ -1 )^ «ff) for some « G W^ 4 ". Then by (jlHUfl 

As A G A c , 14 1, Th. 2.16 and Th. 3.6, imply that 

7r x (h)v x d(hM) = ^-v H 

H/M a \ A ) 

with the left hand side understood as convergent H^-valued integral. 
Thus with z = ga ■ xq one obtains that 
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/(04(e) = 



S 5 (z) 



completing the proof of the lemma. 



1 



H/M d s (X) 



(vr A ( a - 1 )7r A ( 5 - 1 ) U ,7r A (/i) WA )d(/ l M) 



□ 



Remark 5.13. If A G A2\A C and ^ / G L 2 (X) A ", then the integral Js R i z ) /(£) d z (£) does not converge. 
However, using the results from ^1] it can be shown that the identity (|5.12|l can be analytically continued 
(cf. Remark l5.9fl to all A G A 2 . Henceforth we understand (|5.12|) as an identity valid for all A G A 2 . 

The formal dimension d(X) is a polynomial in A, explicitly given by 
(5.13) d(A) = c- J] (X-p(c),a) 

with cela constant depending on the normalization of measures. 

The right action of T on S + induces an identification of U(ic) with G-invariant differential operators 
on 3_)_. As usual we identify U(tc) with polynomial functions on tc- In this way d(X) corresponds to 
a G-invariant differential operator C on S + which acts along the fibers of S + — > F + and has constant 
coefficients in logarithmic coordinates. In particular, 

£0 = d(A)-0 (0G0(~ + ) A ). 
Combining this fact with equation (|5.12l) we obtain the main result of this paper. 
Theorem 5.14. Let f G EagA 2 l2 { X )\" c °( d +)- Then 

f - (Cf) v . 



6. The example of the hyperboloid of one sheet 

This section is devoted to the discussion of the case G = Sl(2, R) and H = SO(l,l). Notice that 
G/H ~ SO e (2, l)/SO e (l, 1). For what follows it is inconsequential to assume that G = SO e (2, 1) and 
H = SO e (l, 1) although the universal complexification of G = SO e (2, 1) is not simply connected. 
The map 



G/H 



gH h-> g ■ 



identifies X = G/H with the one sheeted hyperboloid 

X = {x=(x u x 2l x 3 ) T £M 3 



1} 



The base point xq becomes (1,0, 0) T . Let us define a complex bilinear pairing on C 3 by 



G C 3 





Zl 




W\ 


z, w) — z\W\ + Z2W2 ~ Z3W3 for z = 


Z2 


,W = 


W 2 




. Z 3 




W 3 



If we set A(z) = (z, z) for z G C 3 , then X = {x G R 3 | A(x) 
SO(3, C) and H c = SO(l, 1; C) ~ SO(2, C). Clearly 

X c = Gc/H c = {zeC 3 A(z) 



1}. Further one has G c = SO(2, 1; 
!}• 
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Our choice of T will be 



T = K = 



cos 9 sin 9 
— sin 9 cos 9 
1 



G 



In particular a = MUo where 

"0 i 0" 

U = -i 


and A = A n = {a, —a} with a(Uo) = 1. If we demand a to be the positive root, then 



iV c 



1 2 i 2 iz 



z e C 



The homogeneous space Gc/McNc naturally identifies with the isotropic vectors E = {C £ C 3 \{0} 
A(£) = 0} via the Gc-equivariant map 



G C /M C N C -> S, gM c N c <->■ g ■ Co where (o 







The correspondence between elements of £ G S and horospheres on Xc is explicitly given by 

C^E(0 = {zeX c \(z,0 = l} ■ 
Elements ( G H can be expressed as £ = £ + 177 with f , ry G M 3 \{0} subject to 

A(£)=Afa) and (£,77) =0. 

A simple computation yields 



» + = {C = e + l r,eS| A(0 = A(t 7 )>1} 



and 



D + = {z = i + !yeI c A (a;) > 1} . 
Next we compute the kernel function. 

Lemma 6.1. For all z G cm<i £ G S one has 

a H (C 1 z)- a = {z,Q ■ 

Proof. We first show that 

(6.1) a H (g)- a = (g-x ,C ) (g G G c ) . 

Observe that both sides are holomorphic functions on Gc which are left iVc and right He-invariant. 
Thus it is enough to test with elements a £ Ac- Then a/f(a) _a = a~ a . On the other hand for a = 



cos 9 sin 9 
— sin 8 cos 8 
1 



with 9 G C we specifically obtain 
(a ■ x Q ,(o) = { 



cos 9 




" 1 " 


— sin 9 




—i 











cos v + i sin f = a 



This proves (|6.1Jl . 

It is now easy to prove the asserted statement of the lemma. For that write £ = g ■ £0 and z = y ■ xo 
for g, y G Gc- Then H6.1|l implies 
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o-h(C 1 z) a = a H {g 1 y) a = (g 1 yx ,(o) = (yx ,g- Co) = (z,0- 

□ 

We observe that A>o = A2 = Z>o • a. Hence Lemma \G. II implies that the horospherical Cauchy kernel 

is 



1 _ 1 

ohCC- 1 )-"-! ~ (C^o) - 1 
The horospherical Cauchy transform for / 6 L (X) is given by 



WxSSFT* KeH+) ... 

with the invariant measure on the hyperboloid X. Finally, we will discuss inversion. Let the inner 
product on a be normalized such that (a, a) = 1 and identify K with a* by means of the bijection 
R 3 A I— > Aa G a*. Then A>o = Z>o and d(X) = A — |. An easy calculation gives 

For / G X]a>o ^ 2 (^)a" C £>(£>+) the inversion formula reads 

' z\- i^f cosht — i-^ 2 - sinh^ 
/( : i = / (£/) I 2a + if cosht - ^ sinhf J dt) 

Z3 — ir sinh t 



where r — yj z\ + z? 
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